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ABSTRACT 


This paper examines the applicability of genetic algorithms m the complete 
GA has been used before in the development of rule sets or high performance membership 

between these two components dictates that they should be designed together simultaneously. GA is fully capable ofcieanng 

toe motion of (he system. ehmtototag «* need for burn* mpu. » *» 

loop We show the application of this new method to the development of a cart controller. 


1 1NTRODUCTION 


Genetic algorithms (GA) are powerful search procedures based on the mechanics of natural selection.. They use 
operations found in natural genetics to guide them through the paths in the search space. They provide a means to search 
faSK bSL of MMUV suetofuUy to • of flmoaon 

optimizations, self-adaptive control systems, and learning systems. ... , rt hnniMn qvstems 

Fuzzy systems erase from toe desire to deschbe complex systems wito simple tools- In 2* 
wtoe mi to either hes e membenhip uf ( 1 ] or (0) to . set. toy systems dtow tor ™°‘ 

10-1 1 This im« tate« the linguistic approach to describing conditions (Le. cold, very wann) used veryday 
Interest in fuzzy comroUere has recently been gaining in popularity across a broad array of 
reason. Fuzzy controllers allow for a simpler, more human approach to control design and do not det T* 1 *5 
modelling knowledge of more conventional control design methods. As systems become more compter 
them mathematically becomes more difficult For this reason, fuzzy controllers provide reasonable, effective altemau es 

classical « i it is easy to see that fuzzy theory can be integrated into control 
of the form /F{ condition) 77/EN{action}. Using these rules, one can create a funcuonal C00 ®^ 

method comes from determining the appropriate rules and determining the shape of the Previously 

This work sought to use genetic algorithms in the design and implementation of fuzzy logic controllers. Previously, 

genermtonof SX £££. hto to . to mmnl, toe eitoer todvely. by 

A task such as this was a natunl candidite for GA since G A will atopt to otsto membership tottoi to ousel toe 
controller to perform optimally, to much toe aame manner. GA could he used to genemto toe rate ■ »*>**« 
rnembershio functions Work had been done using GA to do each of these tasks separately, but since the two are co- 
dependenMiring a hand-designed rule set with GA designed membership functions or hand-designed memtership ftmcuons 
S?OA not use GA to its full advantage. Thus, the use of GA to determme both simultaneously 

and determine an optimal or near-optimal controller was the main objective of this wort 

The probtemused to check the effectiveness of this method was centering and stopping a cart located on aone- 
dimensional track as described by Thrift 1 . Given an initial velocity and location on the track, the objective was to determ 
a controller which will bring the cart to zero velocity and zero location in minimum time. Different controllers were design 
for this problem by dividing the input and output spaces into different partition sizes. 


2 GENETIC ALGORITHMS AND FU T EL 


2.1 Genetic Algorithms 


Genetic Algorithms are general purpose optimization algorithms with a P rob#bilis *i c 
means to search poorly undentoo&hregular spaces. John Holland originally developed GA and provided its theoretical 
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foundation in his book. Adaptation in Natural an d Artificial Systems 1 . Holland developed GA to simulate some 
processes observed in natural evolution. Evolution is a process that operates on chromosomes (organic devices tor encocung 
the structure of living beings) rather than on living beings. Natural selection links chromosomes with the performance otuieir 

d ecoded structure. The processes of natural selection cause those chromosomes that encode successful structures rep 

more often than those that do not Recombination processes create different chromosomes in children by combining material 
from the chromosomes of the two parents. Mutation may cause the chromosomes of children to be different from those o 

their P 01 ^ appropriately incorporates these features of natural evolution in computer algorithms to solve difficult Problems 
in the way that nature has done - through evolution. GA requires the problem to be maximized (a minm Restated 

in the form of a cost (objective) function. In G A, a set of variables for a given problem is encoded into a *^<* *”* 
coding structure), analogous to a chromosome in nature. These strings arc converted to ^ 

mapped over the range allowed for the variable. This value is then used to evaluate the cost fiction. jJJ?! * 

GA selects parents from a pool of strings (population) according to the basic entena of "survival of 

new strings by recombining parts of the selected parents in a random manner. Although GA is a«ochasuc method, 

a simple random walk. It exploits historical information to guide the search with improved performance. 

The repopulation of the next generation is done using three methods: reproduction, crossover, and mutation. 
Reproduction means simply that strings with high fitnesses should receive multiple copies in the . . 

strings with low fitnesses receive fewer copies or even none at all. Crossover refers to taking a fit 

parts at a randomly generated crossover point and recombining it with another stnng which has sdso been spht at to rame 
crossover point. This procedure serves to promote changes in the best strings which will give g 

Mutation isthe random alteration of a bit in the string. This will assist in kee^ng diversity in the popuhmcxi. 

In explaining the inner workings of GA, let us initially make a few definitions 5 . Since we are deahn* ' J?* “jjjj 
strings, a notation must be developed to denote similarity subsets {schemata). A schema is a sunilanty subset which co 

similarities at tome bit positions. We can expand this thinking even further with the «nttoductionofa wdd 
S duutoS Mn addition to the biSy set {0.1). For example, the set {0001.0101.0011) can to tacriW to Ore 
similarity template 0**1. Using this notation, we can now define a schema’s order and defining length. For a 
h, its order o(h) is defined as the number of fixed bit positions within that schema. The defining kngthof a schema, 8(h). 

is the distance between the outermost defining positions of a schema. As an example, the schema 01 0 has order 3 

defining we ^ now present the fundamental theorem of genetic algorithms, the schema theorem*. The 

schema theorem enables us to calculate a lower bound on the expected number of a particular schema, h, following 
reproduction, crossover, and mutation 2,3 . The theorem is stated as: 


Uh.t+1) s Mhj)^j.\i - P'T - p.*(A)j 


where X is the expected number of schemata, t is the generation index, / is the overall stnng length. f(h) is the average fitness 
of those strings representing the subset h, f is the average fitness of the entire population, p c and p are. respectively, the 
crossover and mutation probabilities. Examining the schema theorem, we see that it states that a schema will grow when it 

is short, has low order, and has above average fitness. .. n . , 

Given a history of genetic algorithms, one might ask what advantages does it have over other methods. GA s 
primary advantage over other methods is its robustness. GA works through function evaluation, not through differentiation 
orotber such means. Because of this trait, GA does not care what type of problem it is asked to maximize, only that it be 
properly coded. Thus GA is able to solve a wide range of problems: linear, nonlinear, discontinuous, discrete, etc. 


Fuzzy theory extends from the inability to describe some physical phenomena with the exact mathematical models 
dictated by more conventional, boolean models. Fuzziness describes event ambiguity. U mea^ the ^gree to whi^an 
event occurs, not whether it occurs 1 . The feet that fuzziness is lacking in precision 1“* *** -r ij. 

researchers. Others, however, see fuzzy theory as a powerful tool in the exploration of complex beca^ of its 

ability to determine outputs for a given set of inputs without using a mathematical model As Jam noted 6 , the basic motivation 
behind fuzzy set theory was the feet that the conventional methods had become so complex that researchers trying to app y 
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them had to make a choice between a complex system and a complex tool. . ^ . 

Fuzzy theory owes a great deal to human language. As explained by Leung . daily languagw^ncX prec y 
characterized on either the syntactic or semantic level. When we speak of temperature in terms such as hot or cold instead 
of in physical units such as degrees Fahrenheit or Celsius, we can see language becomes a fuzzy variab le sp J^ 
^not^ooU imprecise. In this *nse. fuzzy theoy becomes easily und^because * ££ 

level language instead of a mathematical language. As an example, consider the 

set describing TEMPERATURE can be categorized as five fuzzy-set values {vay ^ 

Very hot(VH)). Figure 1 shows one possible set of the membership functions of the fuzzy-set ^JC,^lLand^ 
for the range of TEMPERATURE 0M30° F. Note that every value of temperature has a membership In every fuzzy 

set although in roost cases this membership is 0. 



Figure 1 Fuzzy-Set Variables for the Fuzzy Variable 
TEMPERATURE 


Also, some values of TEMPERATURE overlap into two fuzzy-value sets. For example a t«np«ture of 47 has 
in both "cold" and "medium" although the membership in "medium" is larger comouter can use Of 

shows how membership functions play the role of discretizing the linguistic £ SCSSTtoS 

course in most respects these membership functions are subjective in naturc^What ^ hv exDeitTwith a 

values or the shape of these membership functions? In most cases, membership functions are ^^by ex^ with a 
SoTwge of to system being analyzed. However, human experts cannot be expected to^videjumal membership 
functions for a given system. Often, these functions are modified iteratively while trying to obtain i optimality. 

How arc these membership functions used in fuzzy controUen? In its simplest fora a ^ 

simply a set of rules describing a set of actions to be taken for a given set of «j»t^Itis easiest to ^ofthese 
if-tten statements of the fora /F(set of inputs) 77 /£N{ outputs). For the example above, a fimzy ccotoUacM be used (ac 
a thermostat. One rule might be IF{ very cold) 7WEN(tum furnace on for x minutes). 

air conditioner on for y minutes) . Since "very cold" appUes to a range of temperatures which also may belong to another 
fuzzv-set variable (Le ^cold") which has rules of its own, the output which results from "defuzzification of the 
oTSesTrules muri take into account how much each rule appUes before determining how much output must be applied. 
Usually a centroid method is used to account for the influence of each rule on the output 


2.3 Anplicabilitv of GA to Fuzzy Controllers 

The application of genetic algorithms to fuzzy logic controllers holds a great deal of£omise_ ** 

been done maSytatwo anL learning the fuzzy rules used in a controller and leanung membaship 
areas are the most time consuming of fuzzy controller design and are for the most part done by 
methodology is lacking in two main respects: it may take too much time to get a 
functions and there is little chance that these sets will be optimal. Genetic algorithms has 

shortcomings. GA’s robustness enables it to cover a complex search space in a rcUdvely ^ ^ g 

an optimal or near-optimal solution. Because of this capability. GA is a natural match f°r f uzz *°*^|j^ «vnthe*ia was 
^Thrift’s pap?«amined the feasibility of using G A to find fuzzy rule*. hi this paper. Tte 

done in decision table fora. The problem examined was centering a cart of mass m on » °“ P* 

objective istomovethecartfroma given initial position and velodtytozero 

is done through die ^jpUcadoo of a force F from the controller. For 100 runs with *2“*** ig^in 

numto of^ne stepsto the hand-designed fuzzy controller to bring the cart to zero position and velocity was 164. In 
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comparison, a GA designed controller using the same starting points had an average of 143 time steps. As Thrift noted.while 
the GA based fuzzy rules performed reasonably well, work could be done to further improve its performance, such as g 

GA determine the endpoints of the membership functions. 

Kan* examined using GA to find high-performance membership functions for a controller for the a pole-cart system. 

The task for the controller is as follows: 

A wheeled cart has a rigid pole hinged to its top. The cart is free to move right or left along a straight 
bounded track and the pole is free to mo\% within the vertical plane parallel to the track. The 
-kept within the predefined limits of the track and the pole should be prevented from falling beyond a 
predefined vertical angle by applying a force of fixed magnitude to the left or right of the base of the can. 

The objective is to bring the cart to rest at the center of the track with the pole balancejjnuch tlKsameas in , Thrift ! paper. 

Also, he examined the use of micro-GA. a small population GA developed by Knshnakumar*. membership 

time controller for the same problem where system parameters may be time varying, to d ^ ni ^i g 

functions, GA was used to determine the anchor points for each of the linguistic variables use± For ^ .^-adapuve 

problem, the GA designed fuzzy logic controller consistently outperformed toe hand-designed 

Stfrate. the performance was even better the non-adaprive author designed control always 

non-adaptive GA controller and the micro-GA designed adaptive controller were always ^^^nSfu^cS^tenSv 
difference between the two GA designed controllers was in their convergence tunes; the mtcroGA controller consistently 

balanced toe system faster than the non-adaptive GA controller. , 

Previous work done with optimizing fuzzy controllers has dealt with optimizing membership functions or rule sets. 

For example, Mamdani and Procyk 10 iteratively designed membership functions. Thrift' used GAto design 

used GA to design membership functions". These methodologies have a major limitation; how can m optimal design be 

obtained when one of the two main components is designed in a non-optimal meth^ 

set and set of membership functions, toe two must be designed together so toe links between them can be foUy 
By using GA to design both simultaneously, the two elements of fuzzy controllers can be fully integrated to debvex a more 

finely tuned, high performance controller. 

I PRfmi-EM DESCRIPTION AND METHODOLOGY 

3.1 Cart-Centering Problem 

A common problem used in literature is toe centering of a cart of mass m, on a one-dimet^nal 1 track. ™e input 
variables for this problem are the cart’s location on the track, x, and toe cart’s velocity, v. The objectire was to ftod a 
controller which could provide a force F which would bring the cart to x -0 and v»0 from an arbitrary initial condition 
and Vq) in minim um time. The equations of motion for toe cart are: 


x(t t) - x(i) + t v(r) 

v(l ♦ t) ■ v(f) ♦ X OH 
m 


( 2 ) 


i m 

l s ; 


e i 
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where t is toe time step. The values for toe constants and the range of values of toe variables are given m Table I. 

Three controllers were developed for toe cart-centering problem. They will be referred to by the number of fuzzy 
sets that partition toe x-location, velocity, and output. For example, the controller which had toe 

sets, toe x-location divided into 5 fuzzy sets, and toe output divided into 5 fuzzy sets was called toe 555 controller. While 
GAwm the Son of toe triangle bases for toe input vtuiables, toe output ftoy ret locations were 

firfd The different output fuzzy membership functions are shown in Figures 2-4. 


Table I Constants and Ranges for Cart Problem 
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Variable or 
Constant 

Value 

m 

20 kx 

T 

.02 sec 

* 

-2 to + 2 m 

V 

•2 to +2 m/s 

F 

-150 to +150 N 
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22 Softwar e and Modifications 

The basis for the software used in this paper is the Simple Genetic Algorithm (SGA) program developed by 
Goldberg 3 . The program was ran on a 25 MHz 80386 computer with a 80387 math coproc«sor The SGA prognm^m 
the useMo define the values for population size, maximum number of generations, probability of c^wr, and 
of mutation. The values used for these parameters are given in Table H. Since run tune became extremely 
size was kept at a relatively small number, 100. This did lead to difficulties when larger string sizes were used and will be 

discussed in the following chapter. 

? } Modificati on of String Structure 

The Simple Genetic Algorithm uses binary rtrinp to encode the parameters wh ich arc to be 
method could also be used in the determination of the fuzzy controller design, a more representative method was chosen. 
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First, the number of alleles was determined from the size of the rule set plustfw number of fuzzy sets 
- Table II Parameters Used in SGA Program 


used to partition the 


Parameter 

Value 

Population Size 

100 

Max. No. of Generations 

100 

P. 

0,7 

P - 

0.03 


spaces of the input variables. For the cart centering problem, the shapes of the trianglra which formed ^ 
fixedf while dJuiput variables, x-location and velocity, were each partitioned using five mangles: me^nn W. 

negative small (NS)! zero (ZE), positive small (PS), and positive medium (PM). The rale SKS. ZE 

x 5) rules to account for every possible combination of input fuzzy sets. The rules are o ’ . oartition 

PC 'nr PMU an h (v is (NM NS ZE PS or PM)) THEN {output}, where output is one of the fuzzy sets used to partrno 

Sa of ten «iglk » Ike *tag » * giv« n* « -4 

allele* (25 + lO^Note that the tetm alleles is used ‘ ns J^ jfhu. 
eedb dde contains either the output tazyaettobeusetl(forlhefb*t twenty-live alWB where NM-1. NS-2 TOO 
^^SSSbfetiZrf loTleogth of the base of the triangles wl^trtfteepjhe .pot spaces «kn last ten 
alleles)- The calculation of the triangle bases from the allele values (1-5) were done as follows; 


1 . 

2 . 

3. 


Subtract 1 from the allele value (making the range now 04). 

Subtract this value from 1 (which is the distance between the peaks of each triangle). 
Double this value and divide by 10, giving the base length for each particular triangle. 


This value can be anywhere 


from 1.2m to 2.0m. 


Thus we are able to incorporate the two main ingredients of a fuzzy controller, the rule set and the membership functions, 
into a single string which GA will seek to optimize. This is shown in the following example. 


String: 14321524321245143122113454525234124 

String: I 1432152432124514312211345J 45252 | 34124 

rule set | x-location | velocity ( 

j locations j locations | 


velocity 


x-location 
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Figure 5 Example of String-Fuzzy Controller Conversion 
4 SIMULATION RESULTS 
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4.1 Initial Conditions 

To find a satisfactory controller, the controller must be able to operate over the entire range of the input spaces. For 
GA to properly design fuzzy controllers, this fact must be integrated into the function evaluation This was done by using 
multiple initial conditions in the evaluation of each member of the population. If a single initial condition were used, for 
example jl. « 0.7m and v 0 * -0.5m/s, then GA would find a controller which would work well around that particular pram 
but may fail elsewhere. This makes the choice of initial conditions an important consideration. The points must be chosen 
to sufficiently cover the input spaces, but at the same time, the more initial conditions used, the more time the program taxes 
to run. These initial conditions are listed in Table m. 


42 Fitness Function 

The fitness function proved to be the most challenging aspect of applying GA to fuzzy controller design. As stated 
earlier, the process finally was divided into two stages, an evolution stage and a refinement stage. In the evolution stage, GA 
was used to find satisfactory controllers, while in the refinement stage, GA used the previously developed controllers and 
attempted to minimize the amount of time needed to bring both x-loca&on and velocity to zero. 

Table m Initial Conditions 


| Controller 

Initial Conditions (xo, vj 

333 

(-2.-2) (-2,2) (0,0) (2,-2) ( 22 ) 

5557 

(-2,-2) (-2,2) (-1,-1) (-1.1) (0.0) (1,-1) (1.1) (2.-2) ( 22 ) 

777 

(-2,-2) (-2,0) (-23) M/3,-4/3) (-473.4/3) (-2/3, -2/3) 
(-2/33/3) (0,0) (2/3,-2/3) (2/33/3) (473.-4/3) (4/3.473) 
(2,-2) (2,0) (23) 


For the first stage, which lasted through generation 30, the fitness function rewarded a member of the population 
according to how well it came to the tolerance value, ± 0J for both x-location and velocity. If the controller succeeded in 
bringing x and v within the tolerance, it was given a fitness relative to the time it took. If the controller "timed out, ttwas 
ftifhfr slightly punished with a negative fitness or slightly rewarded depending on x-location and velocity. If the controller 
diverged, the fitness was given a larger negative value. The first fitness function is shown below. 





if (|x| < 0.5) and (| velocity! < 0.5) then 
fitness ■ 8 175 / time 

else if (time m 175) then 

if (|x| < 1.0) and (|velodty| < 1.0) then 
fitness ■ 34 / sqrt( x 1 + velocity 3 ) 
else 

fitness = -1 
else 

- fitness « -7 


The total fitness was then given by the sum of the fitnesses determined for each initial condition. Through the use 
of this reinforcement/reward scheme, GA was able to develop controllers which could solve aU the initial oondtoow. 

The second stage, from generation 31 to generation 100, was based almoa completely onto*. 
reached die tolerance values it was rewarded according to how short a tune it look. If the controller tun t, 
punished according to how much it missed the tolerance values, and if the controller diverged, u was a t*® 
negative fitness which would probably ensure its failure to continue on to the next generation. This fitness function was g 


if (|x| < 04) and (| velocity! < 04) then 
fitness « 3 * (175 - time) 
else if (time * 175) then 

fitness » -42 * sqrt( x 3 + velocity 3 ) 
else 

fitness ■ *300 


4.3 333 Controller 

The 333 controller was the simplest controller to design. It consisted of only 9 rules, and the number of triangle 
base locations to be determined was 6, yielding a total string length of 15. The controller determined by is s wn in 

Figure 6. 
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Figure < 333 Controller 
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The 555 controller used 25 rules and needed 10 alleles to determine the location of the ^ 
covering the input spaces. With a total string length of 35. the first indication that better performance 
!^puJ» ^became apparent Considering that each allele could have a vjlue 
ifa binary string had been used. 3 bits would be necessary to represent the same mformation. 

length of 105. A population of 100 cannot begin with enough diversity to ensure “‘f ** ^ ^ between 

covered to enable GA to find the optimal solution. Even with a relatively small population size, the 

to three hours. However, the performance of the controller did indicate that GA was findmg a 
controller. Figure 7 shows the resultant best controller determined by GA. 




Figure 7 555 Controller 


Controller 


The final controller designed was the 777 controller. This controller took the most computer time to design because 
of the long string length (63 alleles) and the large number of initial conditions (17). Run times took between seven and e gh 
hours. The best performing controller designed by GA is shown in Figure 8. 


Once GA had been used to determine the different controllers, a study was made to determine their performance and 
stability ^^^Tn^S^d to determine smbility for fuzzy controllers as there is ^^cal^dstare- 
space controllers, a ’brute force’ method was adopted. To examine the controllers, the input : spye of each 
S^dta?40^)inta. Then each point was examined, one by one, to determine if the 

Fi40 points in the x-tocation space and 40 points in the velocity £***»£ 

Stability of aWroller to udsfy all these points doe. » J2 wSS 

point to make a controller unstable), this did ensure some measure of confidcnce m fee proc ure, 
point, it was a simple task to also count the number of time *ep« used to *^f**^^^ 

and these numbers are given in Table IV. Also shown in Table IV is an additional 555 controller designed with 


C 


membership functions fixed GA was used to design only a rule set, with the membership function being done by hand This 
controller, shown in Figure 9, was created for comparison purposes to illustrate the importance of membership function 
selection. As Table IV shows all the controllers were able to successfully bring the system within the tolerance values. 




Figure ft 777 Controller 
Table IV Comgarisonof^ 


No. of Initial Conditions 


333 


1600 


555 


1600 


777 


1600 


555 

fixed 


Time Steps Required 


82380 


68208 


78958 


90156 


Avg. No. of Time Steps 


51.49 


42.63 


4935 


5635 


% Difference w/555 Controller 


20 . 8 % 


143% 


323% 


No. of Failures 
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Table IV shows that the best performance, on average, came from the 555 controller. The 333 controller, while being 
the simplest, did not have the flexibility to produce fast response times. On the other hand the 777 controller had too much 
flexibility and became bogged down in the number of rule evaluations required for each force calculation. Finally, note that 
while the 555 controller with the fixed membership function was able to bring the cart to equilibrium for all points, its 
performance was clearly inferior, needing almost 1/3 longer than the GA designed rule set and membership function 
combination, indicating the importance of proper membership function design. 


x 



Figure 9 555 Controller w/ Fixed Membership Functions 


This paper clearly shows the potential for using genetic algorithms to solve optimization problems. The ability of 
fuzzy logic controllers to provide control where more conventional methods become too complex has also been shown by 
researchers. This work has shown these two, fairly new, methods can be used to together to form controllers without the 
previously needed human expert This methodology allows the complete design of both major components of fuzzy 
controllers, die rule sets and membership functions, leading to high performing controllers which are completely computer 
designed We have shown three different controllers for the cart problem, each of which was able to bring the cart to 
equilibrium over the entire ranges of the input spaces. While these results are encouraging, more woric must be done on 
refining the process. First, more powerful and faster computers will allow the use of larger population sizes, and, therefore, 
greater diversity. Work will be done to examine die development of a robust controller, where the parameters m the equations 
of motion are nc longer fixed to a specific value, but can instead be a range of values. Also, *be need to ensure 
performance of the controller when faults occur in the rule set should be investigated to see if thu would alter the 
configuration of the rule set. Finally, controllers for other problems should be developed to show the effectiveness o. this 
method 
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